METHOD AND APPARATUS FOR REAL-TIME VIBRATION IMAGING 



This application claims the benefit of United States Provisional Patent Application 
No. 60/460,542 filed April 3, 2003 and entitled "System and Method to Remotely Detect, 
Image, and Characterize Ground Vibration or Vibrating Objects or Surfaces" by Melese, et 
5 al., and incorporates that application by reference. 

Background of the Invention 
The present invention relates to a system and method for remotely detecting objects 
that undergo vibration or other acoustic or seismic stimulation, including single-pulse shocks. 
10 Various systems have been used to detect vibrations in target scenes or objects, 

including seismic detectors, using such apparatus and techniques as accelerometers, laser 
Doppler vibrometry or velocimetry (LDV), near-field acoustic holography, and so on. In the 
cases of accelerometers and LDV, apparatus currently in use detects oscillations at single 
points or regions of interest, with high precision but lacking the ability to generate an acoustic 
15 signal image of the target region and thus lacking the ability to derive useful information 

from such an image. For instance, certain phenomena, such as transient acoustic signals and 
turbulent events, cannot readily be detected in the signal analysis of acoustic signals from a 
target region with the use of single-point detectors. 

Near-field acoustic holography can detect acoustic signals from multiple points, based 
20 upon sound pressure, but the complexity of the necessary equipment and set-up is high, and 
thus does not present a practical approach for many applications. 

A system is accordingly needed that can simultaneously and in real time detect, 
sample and process acoustic signals (which may be seismic signals, as discussed below) from 
J multiple correlated points on a surface of a target region of interest, to generate displays and 
25 otherwise output analytical information relating to the entire target region, with equipment 

that is quickly and easily set up, without requiring contact or proximity with the target region. 



Summary of the Invention 
A system according to the invention includes a photodetector array that is configured 
to receive light reflected or emitted from a target object (or scene). The light from the target 
object modulates due to vibrations in the target object. The received light is sampled at some 
5 predetermined frequency, such as at 1 kHz, and is periodically stored, such as once per 

second, to generate a series of data. Each set of periodically stored data thus includes time- 
correlated signals received at the photodetector array, and each photodetector of the array 
receives light from a particular region of the target object, so that a series of full images of 
the target object is generated, each image including oscillation data for the regions of the 
10 target object derived from the modulated light, which may accordingly be referred to as 
acoustic or acoustically derived signals. 

The received signals are AC-coupled (high-pass filtered) to isolate oscillation 
information from information relating to ambient light reflected from the target object. The 
filtered acoustic signals are subject to analysis or transformation, such as a Fourier transform, 
15 to extract frequency information from the signals. 

This frequency information can be used for various types of analysis. If the target 
object is a building that houses machinery, the frequency information can be used to monitor 
vibrations for any changes that might indicate a problem with the machinery. If the target 
object is a region of the earth's surface, the system may be used in conjunction with seismic 
20 exploration techniques to detect subsurface structures such as oil deposits, aquifers, mineral 
veins, or the like, or to detect buried artificial objects such as pipelines, power lines, and so 
on. 

The received light may be optically filtered at the detector array to remove unwanted 
components of ambient radiation. 
25 The system and method of the invention provide the capability of analysis of the 

acoustic signals to identify both oscillatory phenomena and transient events, as well as to 
detect turbulent events in the target scene. 
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Brief Description of the Drawings 
Figure 1 is an illustration of light reflecting from a vibrating surface to a light sensor. 
Figure 2 is an illustration showing tilt amplitude in a vibrating surface similar to 
Figure 1. 

5 Figures 3 A-3B illustrate a basic configuration of apparatus according to the invention. 

Figure 4 shows a more detailed geometry of a setup of apparatus according to the 
invention. 

Figure 5 is a graph of infrared light reflected from a sample (dirt). 

Figure 6 is a graph of visible light reflected from samples (dirt and asphalt). 
10 Figure 7 is a graph comparing results of an apparatus according to the present 

invention with a conventional geophone used for seismic-acoustic detection. 

Figure 8 is a graph illustrating a spectral response of an apparatus according to the 
invention as used in a biological application. 

Figure 9 is a graph illustrating frequency response of an apparatus according to the 
1 5 invention in the setting of Figure 8. 

Figure 10 is an illustration of one embodiment of apparatus according to the 
invention. 

Figures 11-14 illustrate superimposition of detected array data generated according to 
the invention over a target region of interest. 
20 Figure 15 is a graph illustrating comparative results of a system according to the 

invention using an optical sensor vis-a-vis results from an accelerometer. 

Figure 16 illustrates another target region of interest for vibration detection according 
to the invention. 

Figure 17 illustrates the correlation of spectral data with pixels in a detector array as 
25 used in the present invention, relating to the target region of Figure 16. 

Figure 1 8 is a graph similar to that of Figure 15, but relating to the target region of 
Figure 16. 
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Figure 19 is an illustration of a power distribution over a detector array in a system 
according to the invention for a particular frequency (here, 30 Hz), correlated with the target 
region of Figure 16. 

Figure 20 is a block diagram of a system according to the invention. 

Figures 21-22 are schematic diagrams of electronic filters and AC- and DC-coupling 
channels suitable for use in an apparatus according to the invention. 

Figures 23A-23C illustrate isolation and removal of DC signals relating to ambient 
light from AC oscillation signals of interest in analyzing a target region according to the 
invention. 

Figures 24-26 illustrate detection according to the invention of wavefronts 
propagating from a vibrating source. 

Figures 27-29 illustrate detection according to the invention of a transient wavefront. 

Figures 30-31 illustrate detection according to the invention of a turbulent cell across 
a target region. 

Detailed Description 

A simple example of a vibrating surface 10 is shown in Figure 1, wherein light source 
20 emits electromagnetic radiation 30, which reflects from the surface 10 and at least in part 
is detected at a light sensor 40. The light source 20 may in general refer to any suitable 
source of electromagnetic radiation, and the radiation 30 may be of any of a number of ranges 
of wavelengths, e.g. visible light, infrared (IR), ultraviolet, etc. Thus, when the term "light" 
or "optical" is used herein, it will be understood that any desired frequency or range of 
frequencies of electromagnetic radiation may be used, and the light source may be naturally 
occurring (e.g. the sun) or artificial (e.g. a laser or a lamp). The sensor 40 is accordingly 
configured to detect the wavelengths of interest, and as discussed below includes circuitry 
and software as needed to capture, process, analyze and display frequencies, relative 
magnitudes and phase information of the detected light substantially simultaneously. 

Although the present invention will be described in terms of light that is reflected 
from a scene, object, etc., it is equally applicable to detection of light that is emitted (e.g. due 



to fluorescence or thermal IR emission) , and thus when reflection is mentioned it may be 
taken also to refer to emission, fluorescence, etc. In addition, reference to a detected "signal" 
should be taken to refer to any such radiation. 

The term "acoustic" will be used herein to the broad sense of any acoustic, vibratory, 
5 pulsed, transient, turbulent or oscillatory phenomenon, as well as to events that are seismic, 
seismic-acoustic, hydroacoustic, etc., in character. Thus, the term "acoustic signal" as used 
herein may be taken to refer to acoustically derived representations of movements or 
vibrations of an object or surface, and in particular embodiments described herein include 
electromagnetic radiation of any suitable wavelength that is reflected, emitted, etc. from an 
10 object undergoing motion as detected by an apparatus according to the invention. 

In general, the term "logic" as used herein refers to electronic circuitry, processor- 
based systems or subsystems or other hardware, software and/or firmware as appropriate to 
implement the teachings of the present invention, and where any one of these (e.g. a circuit or 
a processing program or routine) is referred to, it should be understood that other hardware, 
15 software or firmware may be used to equivalently implement the same functions or features. 

Surfaces that are subject to shocks, oscillations or forces that otherwise cause them to 
move may set up characteristic vibrations, and in particular may vibrate at frequencies that 
are useful for analysis, e.g. to determine underlying faults or other causes in a target object or 
scene. As discussed below, the present invention is applicable to imaging and processing of 
20 signals detected from regular oscillations or from single-impulse or other nonrepetitive 

motions of a surface or a scene. Thus, where any of vibrations, oscillations, pulses or other 
motions are referred to herein, it will be understood that any combination of such motions (or 
lack of motion, for particular regions of a scene) may be present. 

When the term "image" or "imaging" is used herein, it may refer either to logical 
25 representation of signals that can be correlated to corresponding regions of the target scene, 
and/or it may refer to an actual visual, display or printed representation of the signals, with or 
without a correlation with a representation of corresponding regions of the target scene. 
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Theoretical Concepts of the Invention 

Vibration imaging (detection, processing and analysis) according to the invention 
utilizes the known phenomenon in optics that characteristics of light as reflected from a 
surface depend upon the angles of incidence and reflection of the light (i.e. incoming and 
5 outgoing angles) relative to the surface. The angular dependence of reflectance from a 

surface is called the bidirectional reflectivity distribution function (BRDF). An additional 
signal contribution comes from the purely geometrical tilt-induced change in flux of the 
incident collimated light on an imaged surface. In real-life complex scenes, sharp transitions 
in reflectance and shadows can amplify the induced contrast in the acoustic signal. 

10 Vibratory motions modulate this surface tilt, in turn modulating the angles and thus 

the reflectance. The net result is that the vibratory motion modulates the amplitude of light 
reflected from the surface. Vibration imaging according to the present invention detects the 
modulation of light reflected from many small areas on the surface simultaneously, and is 
therefore a measure of surface motion (or lack of motion, for regions undergoing no 

15 vibration) in terms of tilt. The optical "contrast," defined in one embodiment as the tilt- 
induced change in light amplitude (light modulation) divided by the total light amplitude (the 
ambient or DC light), is substantially proportional to the surface tilt for small angle changes. 
Other definitions of "contrast" as used herein may be suitable, with the common concept 
being that the tilt-induced change in light amplitude is detected and used to determine the 

20 vibration characteristics as described. 

Figure 2 illustrates a vibrating (or otherwise moving) surface 100, and light source 
110 transmits light 120 to the surface 100. The light 120 reflects from the surface to detector 
130, and is modulated depending upon the tilt amplitude of the surface 100. 

Figures 3 A-3B illustrate in greater detail a basic configuration of the invention, 

25 showing a detection apparatus 150 aimed at a surface 160, with enlargement 170 detailing a 
local perturbation of the surface. The tangential vector 1 75 represents the motion a laser 
Doppler vibrometer (LDV) (velocity) or an accelerometer would measure. The change in tilt 
of the small line segment 180 of the surface 160 denotes the field of view of a single pixel, 
which causes the light reflection angle (0) to change from that shown as arrow 1 85 to that 



6 



shown as arrow 190 and then back again as the surface vibrates. The change in reflectivity 
with this angle is described in greater detail below. The modulation in the light intensity 
from a given "unit" area 180 as in Figure 3B is measured by one of the pixels in the image 
produced by a vibration imager of the invention. This "unit" area 1 80 may vary in size with 
5 different lenses or fields of view of a system according to the invention. 

Figure 4 shows a general deployment geometry for an imager that may be configured 
to incorporate features of the invention. A light source (which may be collimated, such as 
sunlight) impinges on the ground at an incident (subscript "i") angle of where subscript 
"n" indicates the angle with respect to the surface normal. The angle 0 in changes with 
10 ground motion. Similarly, the reflected light is viewed by the receiver (subscript "r") at an 
angle 0 r , n with respect to the normal. 

The light source may as indicated be collimated, and/or it may be coherent (such as 
laser radiation), or it may be neither. For interior applications, an active collimated 
illuminator can be used, which has the advantage that it provides control over the light 
15 angles. The illuminator light can be broadband and visible, like sunlight, or it can be narrow- 
band (such as a near-IR laser). Photodiodes or other photodetectors of suitable sensitivity 
should be selected, depending upon the light source. 

The light source should also be of sufficient intensity to limit shot noise and overcome 
background ambient light, and preferably have minimal temporal modulation, i.e. variation in 
20 the intensity of the light source over time. Battery-powered spotlights are suitable for many 
applications. 

In prior systems, the use of an accelerometer or LDV entails measuring a single spot 
on the target surface at a time, so in order to spatially sample a surface (i.e. produce a 
vibration image), the LDV must be scanned or an array of accelerometers would have to be 
25 used. In the present system, by way of contrast, an array of simultaneous images is generated 
from, e.g., 256 contiguous (or alternatively, at least partly contiguous and possibly partly 
separated in space) target spots, thus providing a full-scene imaging sensor for analysis of the 
target scene. 
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Equation A-l below gives the light amplitude P at the receiver in terms of the incident 
irradiance I, atmospheric transmission T, the BRDF b, an imaged surface element area A r , the 
receiver aperture A ap , the receiver height above the ground H, and the angular dependences. 
(Atmospheric transmission effects J, can be ignored for these short ranges.) 

P = l ao )^ ■ COS*,, • fir, ) " XT° r a ■ ^° ^ ( A - ] ) 



Equation A-2 shows how the Vibration Imaging signal, the optical contrast AP/<P> is 
proportional to the surface tilt A6 h i.e., the change in angle of the subtended area A r as the 
imaged surface vibrates. The proportionality has a geometrical dependence tan/9,> on the 
incident light angle and terms arising from the partial derivatives of the BRDF b with respect 
to the incident and reflected light angles. 
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In the laboratory, data were collected using a controlled tilt-platform and various 
illumination and sensor angles, as shown in Figure 2. The resulting plots of Figures 5 and 6 
shows the substantially linear relationship between the measured optical contrast and the 
measured (using two displacement sensors) surface tilt for dirt and asphalt surfaces at 
different illumination wavelengths. This setup was used to verify that equation A-2 
accurately describes the dependence of the optical contrast on the illumination and receiver 
angles. 

The signal in units of contrast per radian of tilt is typically on the order of 1 /radian or 
10" 6 / iiradian. This can also be derived from equation A-2 by assuming a Lambertian 
reflector (i.e., b = constant), for which the contrast per radian of tilt (AP/<P> / A6 t ), reduces to 
tan0, f „, which also gives 1/radian at 45° from the normal and 6/radian at 80° from the normal. 

The above results thus indicate that the modulated light signal is substantially linearly 
dependent upon the tilt magnitude of the target surface. 
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Figure 7 is a graph illustrating a comparison between the tilt - as measured by a 
vibration imaging system according to the invention - and velocity, measured using a 
conventional geophone, of a vibrating surface, e.g. for studying seismic (or seismic-acoustic) 
signals. The results are plotted as a function of frequency with the optical (vibration imager) 
5 data plotted as square dots in units of optical contrast (left axis) and the geophone data plotted 
as diamond-shaped dots in units of vertical velocity (right axis). The excellent shape 
agreement of the two data sets shows the correlation between these two types of 
measurements, and validates the approach of the present invention. 

Figure 8 is a graph illustrating the spectral response of a system according to the 

10 invention as used in biological setting, in which voltage-sensitive dyes may be used to 

produce spatial-temporal maps of electrical activity in biological systems, such as the heart, 
neurons, etc. In this case, in a wavelength range of about 450 nm to 900 nm, the photo 
sensitivity is between a Q.E. (quantum efficiency) of 50% and 100%, with 100% being an 
ideal response. Thus, a broad spectral response can be achieved. Figure 9 is a graph 

15 illustrating the frequency response the same biological setting, and shows that a substantially 
flat frequency response is achieved for vibrations out to several kHz. 

Embodiments of the Invention 

Figure 10 is a diagram showing the basic configuration of a complete system 

20 according to one embodiment of the invention. In this example, a target object of interest is a 
helicopter 200, which will undergo oscillations while in operation that may be of analytical 
interest, to determine sources of malfunctions or for normal operation analysis. A detector 
array is included in a camcorder 210 or other detecting apparatus, and communicates (by a 
network connection, a wireless channel, or the like) to a processor-based system 220 coupled 

25 to a display 230 and user input apparatus such as keyboard 240 (and/or mouse, trackball or 
other digital input devices, not separately shown). 

A suitable detector array 300 is shown in Figure 11, and in this embodiment may 
include a 16x16 photodiode array (PDA), thus including 256 elements, though larger or 
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smaller arrays may also be used. As an alternative to photodiodes, the individual detectors 
may be CMOS devices or other opto-electronic devices as appropriate. 

A lens 250 (see Figure 10) focuses light 260 reflected from the target object (here, the 
helicopter) onto the photodiodes of the PDA, and the photodiodes convert the light into 
5 electric currents in a conventional manner. These currents are filtered and amplified using 
standard electronic techniques, as described in greater detail below, and the outputs from the 
photodiodes are then digitized and recorded (i.e. digitally stored) at some predetermined 
frame rate, e.g. at a sample rate of 1 kHz. Other frame rates may be used, and the frame rate 
may be altered when desired, including dynamically altered in real time based upon 
10 predetermined criteria and/or user input. 

In general, in some embodiments of the invention the processor or processing module 
will be configured to generate processed outputs relating to the detected acoustic signals at 
predetermined regular time intervals, where the time intervals are larger than time intervals 
corresponding to the predetermined sample rate. For instance, a sample rate of 1 kHz and a 
15 processing interval of 1 second may be used, a sample rate of 1 GHz and a processing 

interval of 0.1 millisecond (for a moving target, with very fast circuitry in the processing 
module), etc. The predetermined sample rate may itself be variable for different applications. 

Lens 250 may be a conventional zoom or telescopic lens, allowing the user to isolate 
or focus in on a particular region of interest in the target object or scene. 
20 Detector logic configured to carry out the conversion, digitization, filtering and 

amplification as described herein may in this embodiment be included in the camcorder 210, 
or may constitute a logic module separate from the primary detection optics and electronics, 
e.g. a logic module coupled to an output of a videocamera and coupled to an input of the 
system 220, or integrated into the system 220. 
25 In one embodiment, the photodiodes of the PDA are AC-coupled to the amplifiers of 

the detector array and the signals are filtered prior to digitization, so that only changes 
(deltas) detected at each pixel or element of the PDA are recorded or stored. Storing only the 
deltas can greatly increase the dynamic range sensitivity of the system. 
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If the scene or target is stationery, then no signal (except perhaps noise) will be 
recorded. If part of a scene is vibrating, then changes in signals from the corresponding 
photodiodes of the array (which correspond to pixels in the resulting image) will be registered 
as fluctuations in the scene. 
5 Those changes in the received signals will in general have associated frequencies and 

amplitudes due to the vibrations of regions in the scene corresponding to the respective 
photodiodes (or pixels). Thus, an apparatus according to Figure 10 (with a detector array 
300) is configured to spatially map the amplitudes and frequencies of vibrations on, e.g., the 
surface of an aircraft such as the helicopter 200. Collecting data from all pixels 

10 simultaneously or substantially simultaneously allows detection and analysis of spatial and 
phase relationships of the vibration over the entire target scene. ("Substantially 
simultaneous" data collection may be defined as data collection for different pixels within a 
time interval that results in correlation errors for the data for the different pixels no larger 
than some acceptable or predetermined limit.) The number of pixels or target spots can 

1 5 readily be expanded. 

The interrogated area of the surface (including the "unit" area corresponding to a 
single pixel and the total imaged area) depends on the geometry of the scene or surface and 
the nature and setting of the lens in front of the sensor head, which may be a commercial off- 
the-shelf (COTS) lens. By using a standard zoom lens, the area of interest and the pixel size 

20 on the surface may be changed easily and dynamically. In an embodiment with a 16x16 
photodiode (pixel) array in the sensor head, the interrogated area is divided into 256 
subregions, as shown in Figure 1 1, all of which are independently and simultaneously 
monitored for frequency and amplitude of tilt. 

In one embodiment of an actual implementation of the present invention, the sensitivity of 

25 the vibration imager, in terms of tilt angle, has been determined to be about 1 (iradian 

(0.00017°), which is approximately the angle subtended by a 1 -meter high stick viewed from 
a distance of 1000 km. To support such a fine resolution, the dynamic range of the sensor is 
preferably about 24 dB, which can be achieved by: 

(a) employing photodiodes with excellent inherent dynamic range; 
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(b) AC coupling to eliminate the large DC component due to the ambient light 
level; 

(c) digitizing the resulting AC signal with high precision, e.g. 16-bit precision or 
greater; and/or 

5 (d) coherently integrating the signal over time (currently over about 1 -second 

intervals). 

The modulated-to-ambient light ratio (i.e., the contrast sensitivity) for this actual 
embodiment, which is of interest here, was on the order of 10" 5 to 10" 6 . A contrast sensitivity 
of at least about 10" 4 (and ideally, 10" 5 , 10~ 6 or better) is desirable in ambient-light settings for 
10 usually expected vibrational amplitudes, for which the modulation of the incipient light due 
to the vibrations may be on the order of only a few ten-thousandths of a percent (roughly 

0. 0001% to 0.001%). 

The helicopter 200 shown in Figures 10 and 1 1-14 is hovering, so that over at least 
short time intervals (e.g. a second or a few seconds), data may be taken without the helicopter 
15 changing position. With faster data collection, data may be taken of a moving object, with 
multiple data sets taken over a period of time short enough so that the target object has not 
appreciably moved. In either case, the detection of the desired data is carried out in real time, 

1. e. as an object undergoes vibration and with processing of the signals to generate an array of 
data correlated with imaged regions of the target scene. 

20 If a root-mean-square (RMS) light modulation signal is calculated for each pixel's 

data, and the resulting values are visually superimposed on an image of the target object, 
where the RMS values are correlated spatially with the correct spots in the target object, an 
image such as that shown in Figure 12 results, where the lighter pixels indicate a greater 
amount of vibration. As expected, the lightest regions are those near the helicopter blades 

25 and regions below the helicopter that are affected by the blades' rotation. Thus, Figure 12 

demonstrates that both visually and analytically a full-scene image is generated that includes 
useful information for analyzing the target scene. 

Figure 13 illustrates the same data as Figure 12, with the underlaid image of the 
helicopter removed. 
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Figure 14 illustrates an overlay (which may be an actual display overlay and/or may 
represent a correlation of data between the target scene and the data) of optical temporal 
frequency spectra with their correlated target spots (or pixels) in the target scene. The 
spectrum from each individual pixel, such as pixel 305, may be separately filtered, processed, 
stored and analyzed. 

Thus, Figure 15 is a graph representing information correlated with pixel 305. In this 
figure, the dashed-line graph represents data detected as optical sensor power spectral density 
(PSD) from an apparatus according to the invention, while the solid-line graph represents 
data detected as accelerometer displacement PSD from an accelerometer placed inside the 
helicopter. PSD represents the frequency response of a random or periodic signal, and 
indicates where the average power is distributed as a function of frequency. 

In both the optical sensor PSD and the accelerometer PSD graphs, a strong 23 Hz 
signal (with multiples or harmonics thereof) is detected. 

Figures 16 illustrates a scene of a nuclear power plant (in this example, Diablo 
Canyon near San Luis Obispo, California). In this example, a system according to the 
invention is focused on the target scene, which includes among other regions a roof region 
310 of the power plant. The RMS light modulation (or spectrum) for the entire target scene is 
illustrated in Figure 17, while Figure 18 shows a graph of the PSD for pixel 320 of Figure 17. 
Similar to Figure 15, Figure 18 shows both the optical sensor PSD (dashed line) and an 
accelerometer PSD (solid line) from an accelerometer placed at the target region. 

Figure 18 demonstrates a peak at about 30 Hz (indicated by numeral 330), which may 
be attributed to generators within the building. Thus, the time-series recording of the data 
and generation of RMS spectra associated with individual target spots provides specific 
information useful for fault detection, analysis, etc. Figure 19 illustrates a display of the 
optical power at 30 Hz for the array of pixels shown in Figure 17. Optical power for other 
frequencies of interest may also be displayed. Note that the lighter regions of Figure 19, 
which are correlated with the detected 30 Hz signal, correspond generally to the lighter 
regions of Figure 17, which are correlated generally with regions in the target scene for which 
vibrations are detected. 
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Hardware Features of Embodiments of the Invention 

Figure 20 is a block diagram of a generalized circuit that may be used to implement 
the present invention. An optical filter 410 may be placed in front of the detector array or 
5 module 420 (which, as indicated above, may be incorporated into or coupled to a 

conventional camcorder, camera, or the like) to reduce reception at the detector module of 
undesired frequencies of light. The detector module 420 includes a detector array as 
described above, and its output is subject to analog processing, such as by being passed 
through a filter circuit 440 (discussed below), and thereafter digitized by a conventional 

10 analog-to-digital converter 450. A digital recorder 460 stores the digitized signals, and they 
are provided to a processor 470 for further processing and analysis. 

Figure 21 is a schematic diagram of a circuit suitable for incorporation into filter 
circuit 440 of Figure 20. In this embodiment, a sensor head such as that available from 
Hamamatsu K.K. (headquartered in Hamamatsu City, Japan - see 

1 5 http://www.hamamatsii.com ) with a suitable photodiode array may be used. A single 
photodiode channel 500 of a Hamamatsu sensor currently in use is shown in Figure 21 . 

In this case, a high-pass filter 505 is used to increase the dynamic range of the 
frequency range of interest. An amplifier/filter board 510 includes both an AC-coupled 
channel and a DC-coupled channel for each pixel, i.e. for 256 channels in the embodiment 

20 discussed above. By filtering out the ambient light signal - which appears in the channels as 
DC (nonoscillating) signals - prior to digitizing it, the AC signals due to vibrations of the 
target scene can be effectively isolated and the dynamic range improved. Thus, the circuitry 
of the amplifier board 510 filters the signals output from the sensor head to separate the AC 
components of the signals from the DC components, and these components are then 

25 amplified and digitized. Each amplified photodiode AC output is independently digitized and 
passed to the computer or other processor-based system for storage and processing. 

Figure 22 illustrates an alternative circuit 520 for filtering out the DC component to 
isolate the AC signal. In this embodiment, a DC restoration is performed within the first 
stage transimpedance amplifier coupled to the photodiode. Circuit 520 is effectively a 
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combination of high-pass filter 505 and circuit 500. In one embodiment, circuit 520 replaces 
both circuit 500 and the circuitry on the board 510, though its output 530 is passed through a 
second-stage amplifier (similar to the DC-coupled channel of board 510) before being input 
to the system 470. 

5 One embodiment of AC coupling according to the invention is illustrated in Figures 

23A-23C. Figure 23 A depicts the overall signal for a given pixel, showing a small AC 
oscillation riding on a large DC offset. In Figure 23B, the DC portion of the signal has been 
substantially removed by the use of AC coupling (i.e. high-pass filtering), thus effectively 
isolating the AC component of the signal, which is then amplified. In Figure 23C, the shown 

10 in Figure 23B has been subjected to Fourier transform - e.g. FFT (fast Fourier transform) for 
real-time processing - or other frequency analysis, revealing the spectral content of the 
modulate signal. For the signal in this example, a resonant frequency response of about 87 
Hz is visible in the resulting graph. 

The simultaneous capture of acoustic signals across the detector array focused on the 

15 target region provides the flexibility of determining the nature of the acoustic phenomena 

giving rise to those signals, and in addition the channel-by-channel treatment and analysis of 
those signals, as described below. This detection and signal processing on the basis of 
individual pixels relating to target "unit" spots provides a powerful analytical tool. 

20 Analysis of Oscillating and Transient Signals 

Figures 24-3 1 illustrate application of a system of the invention to the detection and 
analysis of signals relating to oscillating and transient signals. 

Periodic Signals 

25 Figure 24 is an illustration of an impulsive source 600 which generates an acoustic 

oscillation generally 610, which includes multiple generally periodic wavefronts 620-640, 
etc., which propagate outwards from the source 600, e.g. at a velocity of approximately 300 
m/s. In a detector apparatus according to the invention, a sensor array 650 receives reflected 
light from a region of interest, in this case covering a region in which three wavefronts 620- 
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640 are at least partially represented. Surface distortions are caused in the target region by 
the acoustic wave, which result in tilts in the surface that modulate the reflected light, as 
discussed above. A vibration imaging system according to the invention provides two- 
dimensional spatial information of this tilt as a function of time, effectively projected onto the 
pixel array. 

In the far-field (relatively distant from the point of impact), the surface wave achieves 
substantially steady-state propagation, such that the disturbance has a relatively uniform 
effective wavelength. 

In this example, the successive wavefronts are separated by about three pixels each, 
and thus one wavelength may be regarded as the distance in the target region corresponding 
to three pixels. If, for instance, each pixel represents a one-square-meter area, then the 
wavelength in this example is three meters. If the waves are propagating with a velocity of 
300 m/s, then the frequency of the oscillation is 300 m/s divided by 3 meters, or 100 sec" 1 
(100 Hz). 

This is illustrated in Figure 25, where the spatial frequency of the detected signals is 
represented in a one-dimensional spatial Fourier transform in the direction of wave 
propagation, showing a peak at a frequency of about 0.3 pixel" 1 , i.e. a wavelength of about 3 
pixels. 

When a temporal or time-domain Fourier transform is performed in the direction of 
propagation (e.g. the x-direction in Figure 24), a peak will represent an effective period in 
seconds. Figure 26 illustrates the result of such a Fourier transform in this example, and 
shows a peak at period of 0.01 seconds, i.e. a frequency of 100 Hz. 

Transient Signals 

Figure 27 is a sequence of diagrams illustrating a transient wavefront 700 propagating 
outward in the x-direction, superimposed on a detector array 710 which is used to detect 
reflected light from a target region subjected to a shock wave or the like resulting in 
formation of the wavefront 700. "Transient" is used here to indicate a disturbance that does 
not have a readily discernable or substantially uniform period or oscillation. In this case, the 
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circuitry and processing logic associated with the detector array detects a signal traversing 
array pixels over time, as indicated by the graph of Figure 28, wherein the slope of the pixels- 
vs.-time curve (or line) represents the velocity of the transient wavefront in pixels per second. 

If a two-dimensional Fourier transform is carried out on the detected signals (after 
filtering, digitizing, etc. as discussed above), the resulting data or graph will show a 
correlation between the spatial frequency (here, 1 /pixel in the direction of propagation) and 
the temporal frequency (here, 1 /second or 1 Hz), assuming the same wavefront velocity (300 
m/s) and target region area corresponding to each pixel (1 meter square) as in the example of 
Figures 24-26. Such a result is illustrated in Figure 29, which depicts an ideal, uniform 
distribution of spatial and temporal frequencies. A diagonal correlation in temporal and 
spatial frequencies is evidence of the velocity of the signal. A two-dimensional Fourier 
transform can also be applied to the propagating wavefront example of Figures 24-26. 

The data depicted in Figures 28 and 29 can be extrapolated into three dimensions (two 
spatial and one temporal), such that velocity vector across the array (with both x and y 
components) can be determined. 

Figure 30 illustrates the situation when a disturbance such as an atmospheric 
scintillation moves as a turbulent cell 800 across a target region of a vibration imaging array 
810 according to the invention. This type of phenomenon may be analyzed according to the 
well-known "frozen flow" model. Although the cell 800 may be determined by some 
systems to be a source of noise (or random signals), a system according to the invention 
correctly determines that the cell is an optical disturbance moving in space (e.g. in the x- 
direction here) and time, similar to the transient wavefront example discussed above. 

Figure 3 1 is a plot of actual data generated by a system according to the invention, 
wherein a two-dimensional spatial-temporal Fourier transform has been performed on the 
data. The plot of Figure 31 shows power density (as contours) vs. the spatial and temporal 
frequency. The presence of a path in the contours (marked by the diagonal line) indicates an 
effective velocity (in pixels/second), and is consistent with the frozen-flow model. If there 
were no spatial-temporal correlation, then the plot of Figure 31 would simply show 
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concentric circular contours about the origin, i.e. the zero spatial (1 /pixel) and zero temporal 
(1 /second) point. 

Scintillations may be considered a noise source, particularly for the long-range 
sensing of vibrations. However, the ability to characterize and understand these sources leads 
5 to the ability to digitally or analytically filter such scintillations out of the data, and thus 
isolate other phenomena of interest. 

Industrial Applications of the Invention 

It will be appreciated from the above that apparatus according to the invention can be 
10 quickly and easily assembled, and detection of acoustic events in the target scene does not 

require contact or even proximity with the scene. Real-time acoustic imaging is achieved of 
multiple correlated points in the target scene, and the resulting acoustic signal data can be 
evaluated and post-processed in a nondestructive manner, allowing for different types of 
analysis at any time. 

15 This leads to multiple types of applications for the invention, such as process 

monitoring on an assembly line (e.g. for vehicles, machinery, etc.), continuous health 
monitoring (pumps, bearings, flow monitoring, etc.), quality control (e.g. noise control), 
predictive/preventive maintenance by detecting incipient failure of machinery, and so on. 
Other applications include the use of an acoustic imaging apparatus according to the 

20 invention to detect seismic ground motion for oil exploration or to detect underground 

structures through the use of otherwise conventional seismic exploration techniques (e.g. by 
the use of explosions or other inducement of vibrations). Such underground structures may 
be naturally occurring - such as aquifers, oil deposits, ore deposits, etc. - or may be artificial, 
such as buried utilities, pipelines, land mines, or the like. 

25 Example of potential applications in medical/forensic fields are also numerous. 

Vibration imaging according to the invention can be used for: 

•quantification of tremors or shaking due to Parkinson's disease or BET (benign 
essential tremor shaking) for drug development and clinical trials; 
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•non-contact monitoring of a patient's vital signs, such as respiration, pulse, 

normal tremors (both rate and amplitude) - especially useful for burn victims; 

•neonatal monitoring, where patients are small relative to conventional monitoring 
"patches"; and 

•detection of micro-expressions (eye motion, fidgeting, etc.) for non-contact lie 
detection of entire face or body. 
These applications of the invention are all enabled by the full-image, non-contact 
nature of the invention, with its capability of pixel-by-pixel detection, processing and 
analysis. Other applications and advantages will be apparent based upon the foregoing 
disclosure. 
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